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SUMMARY 



The flow of educational information is the administrative life- 
blood of the New York City Board of Education. Fiscal, legal and policy 
requirements of the public school system demand the col lection of a 
variety of school-based data on pupils, staff, physical facilities, 
expenditures and programs. Despite the obvious need for a comprehensive 
and responsive educational data capability, however, the Board of Education 
lacks an adequate mechanism for meeting educational data requirements. 

FINDINGS 

The purpose of this study was to develop an action plan for alleviating 

problems in the collection, processing, and dissemination of educational 

data so that the Board's information requirements are met in an accurate, 

comprehensive and timely fashion. To support this, the study utilized 

the Data Base Management concept to analyze three topics: 

♦ 

• Data Base Administration 

• Data Base Structure 

• Data Base Standards 

Data Base Administration 

The objective of this component of the study was to determine how the 
Board of Education currently estab I ishes organizational responsibilities, 
procedures and standards to handle the administrative aspects of educational 
data collection, processing and dissemination. The study found that the 
existing fragmentation of organizational responsibility into a number of 
separate data process units greatly limits the Board's ability to success- 
fully meet its educational data requirements. This limitation not only 
affects the ability to meet specific, one-time data needs, but also af^pcts 
the mandatory and routine reporting needs of the school system. 



-i'i- 

S;.'i?cif ical ly, there are three major problems that seriously hamper 
the administration of the data process. 

* Existing data units lack direct contact with management . 
This particular problem is due primarily to the present 
organizational f ragmenta ion. Historically, the educational 
data units were created as the need for particular activities 

' — facilities planning, zoning, school s'afety ~ developed. 

Most data units, therefore, see their mandate in terms of 
the particular data requ i rements of their function (or of 
their immediate organizational superior). Unit contact 
witfrmanagementj:j:_the Board of Education, Chancellor, 
Deputy Chancel lor, ^aTrilj^^^ExeGutXveJDi rectors — is infrequent. 

This lack of contact with managment has two Tmportant--.- 

consequences. First, the passage of time has rendered "^^^^ 
some data "requirements" obsolete. Data which were 
necessary for the operation of the school system in the 
I950's are no longer critical or even used In the I970's. 
As a result scarce resources of time and staff are employed 
on activities having little or no value. Secondly, as a 
result of issues^arising out of a dynamic social environment, 
the Board has been repeated I y faced with the need for timely 
and accurate data on a variety of factors not routinely 
col lec;sd. Such situations call for clear {ines of authority 
and responsibility to provide the necessary i nformat ion. 

* Data unit operations are too labor-intensive . The col I ectlon 
of educational data from the field requires careful manual 
inspection of the returned forms for correct coding, legibility 
and missing data. Unfortunately, much of this collected data 
is currently being manually processed as well. Outside of 
their routine reporting responsibilities, none of the Board's 
data units have the capability to process and analyze data 
other than manually. Any request for even the most rudimentary 
data analysis (such as a frequency distribution of schools by 
ethnic ccrnposition) will require a manual effort which may 
take days or weeks to complete. Frequently, the Board is 
required to provide data with such urgency that the luxury of 
one week's time to do a manual analysis simply does not exist. 
In such instances, the Board may be forced to use whatever data 
is on hand to meet the request. 

* Redundant Data Operations are Common ^ In addition to performing 
many of their operations manually, the data units also duplicate 
each other's manual operations. Because of the existing 
organizational fragmentation, data units are either assigned 

(or take upon themselves) data processing and analysis functions 
already handled by other data units. Such redundant efforts 
. are a waste of staff time which could be better used on other 
activities. Perhaps more critical is that redundant efforts 
result in a proliferation of differing statistics all proporting 
to be the same. 
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Data Base Structure 



The objective of this component of the study was to determine how the 

Board of Education devel ops and structures its educationa I data base. The ~~ 

study found that decision-makers within the Board are hard put to manage — 
and use — their educational data to full potential. Basically, there are 
two major problems that seriously limit the usefulness of the educational 
data base, • . 

• Existing data systems are outmoded . The management of data 
at the Board has generally developed in a fragemented fashion 
and at rather low organizational levels. The traditional 
approach to educational data processing used by the school 
system involves collecting and coding data for specific 
computer programs and thereby linking them more or less 
permanently and exclusively to these programs. This type 

'"^""--"-.^^ of data structure — separate data files feeding Into 

^^spec-I^JXzed reporting systems — severely limits the ability 
to combine and^-anaLyze data elements from separate data files. 
In order to analyze dataTrontai-ned -on-^two_s,epaxat^^ „ 
would be necessary to first perform record-by-^record match 
sorts for the two files and then produce a new data file con- 
taining all of the necessary data-. The time and effort re- 
quired to do this often discourages requests for such 
analyses or leads to a manual computation of the data from 
printouts, 

• Data inventor y and dissemination procedures are poor ^ 
Immediate requests for information can generally be satisfied 
only if the data, in terms of format and content, are contained 
in regular unit reports, printouts, or publications. All of 
the data units are tied into their routine reporting systems; 
any non-routine requests must await t Ime-consurnI ng manual com- 
putations before being satisfied. Requests for hists>rical data 
more than two or three years in age often face delays because 
of chaotic or inaccesible filing systems. Unit staff are r^ot 
always familiar with the types of data available In their offices 
Data documentation manuals and information libraries are non- 
existent at the Board and data requests are often dependent 

upon the availability of a single individual who knows which pHe 
of paper can satisfy the request. 



Data Base Standards 

The objective of this component of the study was to determine how and to 
what extent the Board of Education uses rules, practices, guidelines, and 
procedures in the planning, development, and maintenance of its 



educational data base. The study found that fragmented administrative control 
and inadequate computerization of the Board's data base has created serious 
problems for the proper maintenance of data base integrity and security* In 
a number of situations, standards and conventions governing data integrity and 
security simply do not exist. Where such standards do exist, they are often 
enforced either informally or not at all. Three aspects of the data standards 
function were found to need immediate improvement. 

• Data quality control varies greatly . Quality control of 
educational data Involves the degree to which the sources 
of data are held responsible, the clarity of data element 
definitions, and the extent of edit checks built Into the 
process i ng system. While all of the Board's data units 
attempt to do a conscientious job of verifying data accuracy, 
they are hampered by personnel and time constraints, and an 
inability to conduct field audits. Only the October 31 
register and the period attendance reports are subject to an 
on-site audit; audits of all other data are limited to tele- 
phone calls to the schools by unit staff to check on missing 
or obviously erroneous data. 

• Data security standards are Inadequate . Data security standards 
ensure that a particular data file will be maintained and 
available for use during a designated period of time. Although 
the Board's Bureau of Management Information and Data . Process! ng 
(BMIDP) has a standard user procedure for retaining data tapes, 
data units have little sense of the relative importance of 
their various files to management, f^st tape files are retained 
for only a year or two. As a result, valuable pupil tapes are 
lost for further computer analysis and the necessary data must 

be recreated from printouts whose own existence is often none too 
secure. 

• Data collection forms are poorly designed . Each year, the schools 
and districts are the unfortunate recipients of dozens of educa- 
tional data forms. Some of these forms are professionally printed 
in easy-to-work-with formats while others are mimeographed from 
poorly-typed copy. Some forms are coded for keypunching while 
most are not. The layout of header information on most forms 

is not consistent even for forms from the same data unit. Some 
forms have excellent Instructions for completion while others 
leave much up to the Imagination of the person completing the 
form. Inevitably, many forms ask for the same information. 
Inevitably, many forms asking for the same information are re- 
turned containing different figures. 
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ACTION PLAN FOR CHANGE 



The study identified a number of serious problems in the Board's 
educational data process. Strengthening thJs data process, thereby enabJing 
it to more effectively serve the information needs of the city school system, 
will require a number of major changes in the administration and structure of 
the educational data baSe. Such changes, to be effective, must impact not 
only on the procedures and systems used by the present data process units, 
but also on the units themselves — their internal structure and traditional 
relationships within the system. 

Accordingly, the action plan consists of the following changes; 

* Create a new Bureau of Educational Statistics . One major 
point regarding the Board's educational data process has 
clearly emerged from this study: almost all of the exist- 
ing data process problems result from the lack of central 
responsibility for the operation of the process. Top 
priority must therefore be given to the elimination of the 
existing data unit organizations and the restructuring of 
their staff and functions into a new Bureau of Educational 
Statistics (BES). BES should report directly to the 
Deputy Chancellor, establishing the necessary communications 
link with management that was missing from the old organiza- 
tional structure. BES i^uould have the sole responsibility 
for the CO} lection, processing (excluding^ of course, actual 
machine processing), and dissemination of all educational 
data not involving pupil testing. Whenever possible, BES 
should serve as a data user clearinghouse, consolidating 
similar data requests by client offices to prevent the 
collection of duplicate data and to maximize data utility. 

A new administrative position of Director of Educational 
Statistics should be created to supervise the new BES, 
replacing two existing pedagogic director positions In the 
Bureau of Educational Program Research and Statistics and 
the Programming Section - Office of Educational Facilitio^.s 
Planning. Because the BES reorganization places very 
heavy emphasis on the development and operation of manage- 
ment information systems, it is recommended that the BES 
director position be established as a Principal Quantitative 
Analyst l ine at the M-^ J V salary level in the Managerial 
Pay Plan. This action wi I I ensure that future incumbents 
in the BES director position will possess the necessary 
technical background for the position. 
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• Develop new computer systems > Most of the shortcomings 
identified by the study centered around manual data pro- 
cessing or limited and inflexible computer programs and 

f i les. To al leviate these problems, six new computer 

systems should be developed during the BES reorganization: 

1. An Annual School Census System to replace the many 
existing overlapping manual and computer systems now 
used to coMect pupil and school facility data for the 
annual October 31 school census. This system wl M form 
the basis of a comprehensive grade-wi thi n-School data 
base. 

2. A Geographic Data Base System to provide for the 
cuiiection a riu process i ng of demographic data down 
to the block level of detail. This system will gen- 
erate detailed and up-to-date inventories of demographic 
data to support such Board activities as school zoning, 
enrol I ment forecasting, redlstricting, pupil busing 

and Integration studies. 

3. An Incident Reporting System to provide for the entry 
and processing of school incident data, and replacing 
the existing manual procedure. The compu-horlzed Incident 
file created by this system would be accesBbd via remote 
terminal to generate a variety of incident reports and 
statistical analyses. 

4. A Pupil Mobility Reporting System to generate detailed 
reports of pupil admissions and discharges down to the 
school level, replacing the present systems which provide 
only borough and district data summaries. 

5. A Professional Staff Reporting System to. provide flexible 
access to position and salary data contained on the regular 
and per-diem professional staff payrolls. The system will 
generate information necessary for analyzing personnel 
survival trends and for determining long-range costs of 
collective bargaining salary offers. 

6. A Preliminary Reports System to pr^luce on-demand reports 
and analyses of "raw" or prellmr-^ y data, replacing many 
of the time-consuming manual procedures now used to produce 
preliminary or special data reports. 

• Adopt a two-phase reorganization plan . The above recommen- 
dations (and others to be found in Chapter 4 of this report) 
for the restructuring of the educational data process should 
be implemented over an eighteen month period consisting of 
two phases. 

Phase I - This phase will extend from January I, 1975 through 
June 30, 1975. At the outset of this phase, the Bureau of 
Educational Program Research and Statistics (BEPRAS) and 
selected staff from the Office of Educational Facilities 
Plannlng's Programming Section and the Office of School 
Safety's Analysis and Statistics Unit will be Incorporated 
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into the new Bureau of Educational Statistics (BES). 
Work will begin on the development of the six new com- 
puter systems 'recommended above, and on microfilming 

educational data f I les. It is expected-. that, three 

(Incident Reporting System, Profeissional Staf f Re- 
porting System, and Preliminary Reports System) of 
the six new systems will be operational by the end 
of Phase 1, 



Phase 2 - This phase will extend from July 1, 1975 
through June 30, 1976, At the outset of this phase. 
Educational Facilities Planning's Programming Section 
and School Safety's Analysis and Statistics Unit, to- 
gether with unit,s of the Bureau of Attendance's Pupil 
Accounting Division will he merged Into BES, In ad-- 
ditlon. Phase 2 will see the Incorporation Into BES 
of other data units not included In this initial study: 
As of this writing, likely candidates for merger 
include the Bureau of School Financial Aid's Survey 
Unit and certain functions of the CentraS Zoning Unit. 



^^^^^^^^ 



The detailed findings of ..the educational data process study are 
discussed in the four chapters of this report. Chapter I provides an 
introduction to the Dato Base Management concept. Chapter 2 analyzes 
the functions, procedures, and responsibilities of each of the Board's 
educational data units, and examines how the present fragmentation of 
organizational authority affects the data process. Chapter 3 examines 
the major shortcomings of the Board's educational data base its struc 
ture and standards — and the problems this creates for the Board's 
top decision-makers. Chapter 4 provides specific recommendations for an 
immediate restructuring of the educational data process to alleviate the 
problems identified in the study. 



Bernard R. GIf ford 
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• To determine short- and long-range needs for 
physical faci I itfes 

• To provide data for collective bargaining purposes 

Despite the obvious need for a comprehensive and responsive educational 
data capabi I ity, the New York City Board of Education lacks an adequate mechanism 
for meeting educational data requirements. Problems exist in all three parts 
of the educational data process - collection, processing, and dissemination. 

1. Data Col lection - This activity involves the preparation and 
distribution of data forms to schools and districts, and the 
subsequent collection and verification of the returned forms. 

2. Data Processing - This activity involves the coordination 
and supervision of al| functions necessary for the successful 
processing of the collected data by computer or manual effort; 
including data keypunch and verification, systems development 
from the basic system design through programming, error listing 
and final report generation. 

3. Data Dissemination - This activity Involves methods and pro- 
cedures for the adequate storage, retrieval and dissemination 
of educational data; Including the reporting of data in three 
ways: recurrent , as in the production of monthly reports of 
certain variables (such as puplf attendance), exception , \ 
notifying management of gnusual behavior (such as an Increase 
in school incidents), or on-demand , in which specific informa- 
tion Is provided In response to a request from management. 

The purpose of this study was to develop an action plan for alleviating 
problems In the educational data process so that the I nformat ion requi rements 
of the New York City Board of Education are met in an accurate, comprehensive 
and timely fashion. To support thts, the study utilized the Data Base Management 
concept to analyze three topics: 



• Data Base Administration 

• Data Base Structure 

• Data Base Standards 
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Data Base Administration 

The objective of this component was to determine how the 
Board of Education currently establishes organizutional respon 
sibl titles, procedures and standj:irds to handle the administra- 
tive aspects of educational data collection, processing, and 
dissemination. The basis for such an assessment was* provided 
by a review of the following factors: 

• Is there a function and/or strategy that addresses 
educational data base rnrriaaement throughout Ihe 
Board? 

• Who has technical respcn'.w'bl I ity for the rial a base? 
Who has non-technical r :ns ibi I i ty (user iniorface)? 



Data Base Structure 

The objective of this comp :-^cr}l* was to determine how the 
organization Is structuring ii.; .lufa base. A review of the 
following factors provided a bii- is for assessment: 

• Is there a strategy to neiermine what comMV>n data 
bases should be developed :md a priority iMrhcdule 
for developnxjnt? 

• Is the exlstlnc] data base designed to support 
research on policy Issues? 

• Can data be viewed logical ly so that It appears 
organized In different ways to various users? 

• How are Information needs determined and to what 
degree Is the user involved? 

• Are future data needs forecast to assure that data 
base capacity and performance can be maintoined? 



Data Base Standards 

The objective of this component will be to delermine how 
and to what extent the Board of Education uses rulers, practices 
guidelines, and procedures in the planning, development and 
maintenance of Its educational data base. A review of the 
fol lowing factors provided a basis for assessment: 
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• What standards and conventions govern data integrity 
and security? 

• What are the coding and classification standards? 

• What are the procedures for data change nomination, 
concurrence, arbitration, implementation, and 
documentation? 

Exhibit 1.2 shows the relationship between Data Base Management and Mie 
educational data process. Notice that each element of Data Base Man'iqement 
administration, structure, and standards — - impacts upon the three aspecli* of 
the educational data process — collection, processing, and dissemination, i-n- 
forcement of Data Base Management principles is necessary for the successful 
operation of the educational data process. 

^^^^^^^^ 

The findings of the educational data process study are discussed In the 
three remaining chapters of this report. Chapter 2 analyzes the functions, 
procedures and responsibilities of each of the Board's educational data units, 
and examines how the present fragmentation of organizational authority affecis 
the data process. Chapter 3 examines the major shortcomings of the Board's 
educational data base — its structure and standards — and the problems 
this creates for the Board's top decision-makers. Chapter 4 provides specific 
recommendations for an immediate restructuring of the educational data procerus 
to a I lev late the problems identified in the study. 



17 



2 - ADMINISTERING THIZ EDUCATIONAL DATA BASE 



Tlie recent reorganization of the Board of Education's central head- 
quarters recognized that clear lines of authority must exist if key 
management functions were to be performed properly. Whi I e the reorganiza- 
tion resulted in major administrative changes at the division level, the 
functions and responsibilities of imsf subordinate offices and bureaus were 
left unchanged. As most of the Board's educational data process activities 
take place at the bureau level, any restructuring of that process must first 
analyze current organizational responsibilities, procedures, and standards 
used to handle the administrative aspects of data. 
Accordingly, the purpose of this chapter is to.- 
Ana I yze the f unci ions , procedures and responsi- 
bilities of each of the existing educational data 
units. 

Examine how the pro;:;enl f t^agrnentation of organizational 
authority and tf^e vipport inn systems limit the Board's 
ability to successfuMy rneet its educational data ro- 
qu i rements. 



ORGANIZATIONAL RESPONSIBILITY 
fOR THE DATA BASE 
I S FRAGMENTED 

Both the traditional role and recent expansion of the Board of Education's 
management responsibi I ities account in large part for the current fragmentation 
of the educational data process. As late as 1949, all statistical and research 
activities, including budget preparation, were i ncorporated in a single Bureau 
of Reference, Research and Statistics under a single director. Because the 
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then existing and unwieldly span of control in the Bureau was hindering im- 
portant administrative and educational decision making processes, the statistical 
and research activity underwent a series of reorganizations which divided the 
data process (collecting, processing and disseminating) along functional lines. 
Over a brief five-year period separate bureaus responsible for administrative 
research, curriculum development, budget analysis, facilities planning, 
educational research and pupil attendance statistics were created. Later years 
saw the creation of new data bureaus for school zoning, personnel planning, 
publ ic i nformat ion. Federal programs, and program analysis. 

In all of these reorganizations, the data collection, processing and 
dissemination activity was seen as subordinate to the operational function of the 
particular bureau. In terms of staffing, this meant that expertise was re- 
quired primarily in tho subject function — ^^ersonnel, budget, zoning — and 
nof- in whcitever dota collection, processing and dissemination activities were 
nocessc I y t' , support that function* The data process, once highly centralized 
end profGiiSionai ized, had become organizationally fragmented and was conducted 
wiih Vtiryino degreos of expertise and efficiency. 

Exhibit 2J shows the existing structure of the educational data process 
for the New York City Board of Education. The organization chart identifies 
fhe five primary data process units and their associated lines of authority. 
The remainder of this section will discuss In some detail the functions, pro- 
cedures and responsibilities of the following four data process units: 

• Bureau of Educational Program Research and StatlstiGS 

• F-^rogrammlng Section - Office of Educational Facilities 
Planning 

• Analysis and Statistics Unit - Office of School Safety 

• Pupil Accounting and Statistical Unit - Bureau of Attendance 

The fifth data process unit — Office of Educational Evaluation — Is In many 
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respects unique from the four other units and does not share most of their 
problems. The "-ole of the Office of Educational Evaluation In the develop- 
ment of the educational data base Is discussed in Chapter 4 of this report.. 



Bureau of Educ ationa l Program Research and Statistics 



The G'jrDau oP Edrjcntional Program Research ond Staiistics (BEPRAS) is a 
direct 6oscen<!^ :v\- the old Bureau of F^eforcnce, Research and Statistics. 
Split off iror,\ h)o o\f\ bureau in 1949 and given its current name and functions 
in 1957, BEPRA::; bocariie the Board's chief adrni o i strati vo research arm and its 
principal stati^Jtica! unit* 



BEPRAS' nvjndatc'; -iS slv::ited in various Board by--lav/s and resol ut ions is 
comprehensive ^i^vJ quite; open-ended. The current stated functions of the 
bureau ^re i he f'o! lowing: \ 



To conduct studies of programs, organizations, personnel, 
rlscal mottors, and school administration, as requested 
by top Board of Fxlucation officials. 

To report, d ! sseml nst'e. and assist in implementing the 
findings or research. 

To coMect, r'ecord;, and analyze systenwide administrative 
and pupil ^ico^UiVnnj} daia. 

To fui-*nl':;h n;nnagement information for high level decision^ 

nicjkiffg. 

To maintain a reference library of pertinent materials in 
the cireab of school administration, school finance, research 
and 3v£iluation, teacher personnel, and statistics, which will 
provide resources for the several functions of the bureau. 

To participate in the preparation and evaluation of circulars, 
bulletins, guidesj and administrative forms. 

To provide information about the City's school system to 
Board of Education units, other municipal agencies, civic 
groups and service organizations. 

22 
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3. To administer the Basic Educational Data System (BEDS) 
for the New York State Department of Education and to 
furnish the unique data provided by this survey to head- 
quarters officials. 

9. To conduct Federal surveys, required to maintain the 
flow of Federal funds. 

To per-form such herculean tasks, BEPRAS has a staff of 39 pedagogical 
.ind adrninifitra-f ivo personnel and a 1974-1975 personal service budget of 
S400,000. Exhibit 2.2 shows an organization chart of the bureau as of 
Juno, 1974. ThG Lairoau is organized into four activity units: 

I • Program Research Unit 

Under the supervision of a School Research Associate, this 
unit is responsible for conducting studies in the area of 
leachor personnel, such as^a continuing survey of classroom 
leacher absence. These data have been utilized in collective 
barojining negotiations with the United Federation of Teachers, 
and hjve provided estimates of per-diem substitute fund require- 
ments for community school d istricts and high schools. The unit 
:ilso ppjpares comparative studies of teacher salaries for major 
U.:;, cities, and New York City teacher salary distributions by 
strDp and schedule for various school levels. 

Administrative Research Unit 

Under the supervision of a School Research Associate, this unit 
is responsible for conducting an annual survey of pupil eligibility 
tor free lunch, and the annual comparability report of Title I 
services for the Federal Department of Health, Education and 
Welfare. This unit assists the bureau head by preparing a weekly 
.JcMvitics report, draft i ng research proposa I s, and summarizing data 
dnd the results of investigations requested of the bureau by 
Bo:jrd officials. The unit also consults with HEW Officials on 
the Office of Civil Rights Survey and the Office of Equal Employ- 
ment Opportunity Survey. 

3. Field Data Collection Unit 

Under the supervision of an Assistant Administrative Director, this 
unit Is responsible for the col lection, editing, processing and dis- 
position of 90 percent of the Bureau's statistical data. Included 
in this are the major data requirements - pupil attendance, ethnicity, 
language ability, and register - for the Board's budget, accounting, 
and fiscal operations, and a number of minor and secondary statis- 
tical data requirements.. The unit also administers the New York 
State Basic Educational Data Survey (BEDS) of pupi I , staff school 
and district data profiles. 23 
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BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 
ORGANIZATION CHART - JUNE 1974 





D 1 RECTOR (Acting) 
1 Supervising Steno 
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ADMINISTRATIVE 
RESEARCH 
UNIT . 




PROGRAM 
RESEARCH 
UNIT 




FIELD DATA 
COLLECTION 
UNIT 




MANAGEMENT 
SUPPORT 
. UNIT 


1 Research Assoc. 
1 Teacher Assigned 
1 Statistician 
1 Stenographer 
1 Typist ■ 


1 Research Assoc 
1 Senior Clerk 
1 Typist 


1 Asst.' Admin. Dir. 

1 Admin. Assoc. 

2 Supervising Clerk 
10 Senior Clerk 

8 Clerk ■ 
1 Stenographer 
1 Senior Typist 


1 Sr. Admin. Asst. 

2 Supervising Clerk 
1 Senior Clerk 

1 Stenographer 
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EXHIBIT 2.3 



BEPRAS' REPORTS LISTING 



REPORT TITLE 



I. Period Attendan 



FREQUENCY REPORT DESCRIPTlnM 



ce 



2. Preliminary Register 

3. Time -Schedule and Register 

4. Transportat icn 



Monthly- 
Annual ly 

Annua I ly 

Annua I ly 

Annua I ly 



5. Age Grade . 

6. H.S. Graduate Ages 

7. J. H.S. and rl. 



Annual ly 
Semi-Annual ly 
S. Examinations Semf -Annually 



8. El em and J. M.S. Promofl 

9. Library 



ons 



0. ^ Ethnic Census 

1. Abi I ity to Speak Engl ish 



Annua I ly 
On Request 

Annual ly 
Annual ly 



2., H.S. RegJstor and Attendance Semi-Annual ly 
' -^-hool Reo^aani^atio^ Annually 



Pupil attendance rate and register 

Fifth school day's attendance and register 

Pupil register on Oct. 31 for all grades 
with data on special schedules, short 
time, and number of classes 

Documentation of reimbursement claims 
for public and non-public school trans- 
portation by pupils and carrier 

Pupils' age, by sex, for each grade 

Age and sex of H.S. graduates 

Percent passing and distribution of test 
scores for Regents and citywide exams 

Pupil promotions by grade 

Library media center data on staff 
materials and services ' 

Pupil ethnicity by grade " ; 

Pupil English-speaking ability by 
language group within grade 

H.S. attendance and register on 

State scholarship and Regents test days 

End of year school reorganization by 
— =^ c/-horil level 
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from the Board's Bureau of Management Information and Data Processing (BMIDP) . 
Given the poor quality of much of the data received from the schools, these clerical 
tasks are absolutely necessary and the bureau staff, with many years of experience 
in data collection, performs with a high degree of competence and professionalism. ; 

Exhibits A,2, A. 3, A,4, and A, 5 provide work distribution analyses for each 
of tne four BEPRAS units. These analyses point out a major shortcoming of the 
bureau's organization. Data collection and processing of forms received from 
the scfiools are not handled exclusively by the Field Data Collection Unit (as 
might be expected) but are also processed by the Program Research Unit (Teacher . 
Absence Survey) and the Administrative Research Unit (Pupil Information Survey). 
Also, all three units spend from 5 percent to 17 percent of their time in various 
phases of the pupil language and ethnic survey. This lack of task specialization 
among the units is evident in other bureau activities — statistical analysis, ad- . 
ministrative record- keep i ng ~ as well. Given the fact that 80 percent of the 

bureau's time in devoted to tv/o activities collection of field data and 

rT!onuc:iI tabuiations of data summaries— the existence of the three separate units, 
with the athondant duplication of superv isory overhead. Is both artificial and 
cosMy, The Management Support Unit, while primarily responsible for the unique 
rask of data dissemination, suffers from the lack of an Information retrieval 
i>ysh^rn and the lack of a common, automated data base and report system to gen- 
erate many of the stat i st i ca I tabu I at ions and summaries requested by board of- 
ficials md now pr'oduced manually. The implications of these shortcomings on 
hhe board's information needs will be discussed later In this chapter. 

Proyramminq Section - Office of Educational Facilities Planning 

The programming section of the Office of Educational Facilities Planning was: 
created in 1951 upon the recommendation of the Education Management Study 

O 28 . 
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(Strayer-Yavner Report). In the report's recommendation, the proposed division 
(now section) of programming would be responsible for formulatingand adopting 
policy actions necessary to achieve the best use of existing school facilities 
and the improvement of those facilities to meet educational standards- The 
new division was to have two subdivisions: 



(1) A school population analysis unit for conducting all 
analysis and planning necessary for the capital budget 
and long-range building programs: and 

(2) A school facilities analysis unit for inspecting school 
buildings and analyzing space utilization. 



The current stated functions of the programming section are the following: 

I- Participation in the development of the master plan for public 
school bui Idlng construction, promulgation of the annual space 
procurement program, and the preparation of the five-year capital 
improvement plan. 

2. Development and evaluation of research techniques and procedures 
for enrollment and other demographic forecasting. 

3. Preparation of the annual report on school capacity, enrollment 
and utf I izatlon. 

4. Estimating the impact of residential housing growth and decline 
on public school enrollments. 

5. Participation in the preparation and review of proposed capital 
budgets for school construction. 

6. Compilation, classification, publication, and d istrl bution of 
information on school use, school construction needs, school 
life-expectancy and auxiliary facilities. 

7. Preparation of five-borough school utilization maps. 

8. Preparation of analysis of capital budget provisions for 
school facilities projects. 

9. Participation in studies by special consultants employed by 
the Board of -Education and outside agencies. 

10. Preparation of school district profiles of current and anticipated 
future utilization of primary and intermediate schools. 

11. Review and development of school capacity formulas. 
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The prografr«r3lng section has a staff of 20 pedagogica T and administrative 
personnel and a 1974-1975 personal service budget of $280,000, Exhibit 2,4 
shows an organization chart of the section as of June 1974, The section is 
organi zed -i nto three activity units: 



I. School Uti I ization Unit 

Under the supervision of a Teacher assigned, this unit prepares the 
annual report on school capacity, enrollment and utilization. This 
report incorporates data on leased and temporary faci I ities and their 
pupi I enrol Iments, use of school facilities for non-instructional pur- 
poses, and the organization of special classes for specia I education 
programs. The unit prepares the annual issue of the five-borough set 
of school utilization maps showing the locations of all schools (existing, 
under construction, or in planning phase), leased faci I ities, and large- 
scale housing developments. The unit also conducts a periodic review 
with .the N.Y.C. Department of City Planning and the N.Y.C. Bureau of the 
Budget of all level school capacity formulae for official modification 
to reflect changing conditions in the schools' organization and 
curriculum. 

2. Program - Planning Research Unit 

Under the supervision of a Principal Planner, this unit participates 
in al I phases of the development of the annual space procurement pro- 
gram and ensuing five-year Capital Improvement Plan of the Board of 
Education for submittal to and action by the City Planning Commission, 
Mayor, Board of Estimate and The City Council. Activities involved in 
this process i nc I ude demographic studies of neighborhoods and community 
school districts involving the compi lat ion, manipulation and interpreta- 
tion of Census enumeration data, population characteristics, birth 
statistics, population migration, ethnic data,^ ^hous i ng data, and his- 
torical trends of public and non-public school enrollments. The Unit 
also participates in the preparation of school district profiles and 
in the continuing section development and evaluation of enrollment 
forecasting methodologies. 

4. Housing Research Unit 

Under the supervision of a Principal Planner, this unit evaluates the 
impact of proposed new residential housing (public, private and 
institutional) on publ ic school enrollments based upon special annual 
questionnaires sent to the schools for collecting data, on enrollments 
of children from housing projects and for the yearly updating of these 
data for caluculating pup i I /dwel I i ng unit ratios of residential housing. 
These studies are used in the development of the annual Space Procurement 
Program. 
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PROGRAMMING SECTION - OFFICE OF EDUCATIONAL FACILITIES PLANNING 
ORGANIZATION CHART - JUNE 1974 



DIRECTOR 



I Admin. Asst. 



SCHOOL 
UTILIZATION 




I Teacher Assigned 

I Junior Planner 

I Supervising Clerk 

I Typist 



I Principal Planner 

1 Planner 

2 Asst. Planner 
2 Junior Planner 
I Statistician 

I Senior Steno 

I Typist 

I Asst. Engineer 



I Principal Planner 

I Junior Planner 

I Statistician 

I Senior Clerk 



As with BEPRAS, a work distribution analysis of current operations and pro- 
cedures was conducted of the programming section and its staff. Exhibit A. 6*shows 
the summary work distribution analysis for the entire section. In general cate- . 
gories, the section's activities consume the following percentages of total avail- 
able man-hours: 

Supervision -10? 
Data Process Activities -6\% 
Clerical and Support -29% 

Approximately 75 percent of the section's data process activities' time is 
devoted to three major statistical activities ~ capacity and uti I ization inventory^ 
housing analysis, and enrollment projections. Uplik^ BEPRAS, the programming 
section's miscellaneous analyses consume only 3 percent of the unit's time. 

Exhibits A. 7, A. 8, and A. 9 provide work di str i bution ana lyses for each of 
the three programming section units. As was the case with the BEPRAS' units, but 
not to the same degree, there is overlapping of activities among the three units, 
^^'s Is particularly true of the Program-Planning and Research, and Housing Research 
Units, both of which spend significant amounts of time engaged In public school 
enrollment analysis. The question arisesas to why the Housing Research Unit exists 
as a separate entity at all since the data it collects and analyzes form an integral 
part of the enrollment and space procurement studies performed by the Program- 
Planning and Research Unit. 

One major shortcoming of the programming section's operations is not evident 
in the work distribution tables. All of the section's data processess — capacity 
and utilization, enrollment projections, housing analysis — are completely manual. . 
None of the section's data collections forms are coded for keypunch, no systems 
exist for computations of utilization rates or enrollments forecasts, and al I i 
reports and data tables have to be typed by hand. This lack of mechanization 
not only imposes a great burden on the staff in processing its own data but also 
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means that data secured from outside agencies (much of which I s avai lable on com- 
puter tapes) must be manually transferred from agency printouts to section data 
worksheets before being subject to further manua I processing. Perhaps worse is 
the fact that much of the data relating to pupil registers and ethnicity is, of 
course, collected by BEPRAS and available on computer files at BMIDP. As a 
result the Programming Section^s lack of automation imposes an additional clerical 
burden not only on its own staff but also on the staffs of every district and 
school who are being asked for the same data twice. 

Analysis and Statistics Unit - Office. of School Safety 

The Analysis and Statistics Unit is part of a Planning Unit funded by a grant 
from the Criminal Justice Coordinating CouncI I and'^establ ished" i n the Office of 
School Safety in February, 1973. The grant award terminated on June 30, 1974 and 
the Planning Unit staff was paid out of the Safety Officers tax-levy budget for 
the 1974-1975 fiscal year. 

The stated functions of the Analysis and Statistics Unit are the following: 

1. To create a research and planning capability for the Office of 
School Safety and to provide a sound data base for analysis which 
will allow informed planning, deployment and budget decisions as 
regards school security . 

2. To analyze the incident data col lected from the schools and to pro- 
duce regular and special reports on these incidents for use by the 
Central Board Members, Chancellor, Office of Public Affairs, and the 
Office of School Safety. 

3. To provide information and assistance to the schools relating to 
their Incident reporting and general security problems. 

4. To computerize all aspects of the Incident reporting process and 
utilize quantitative analysis techniques In studying crime in the 
pub I ic school s. 

The analysis and statistics unit has a staff of 5 administrative personnel and 
a 1974-1975 personal service budget of $48,300. Exhibit 2.5 shows an organization 

chart of the unit as of June. 1974. 

\ ■ : . -. 
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EXHIBIT 2.5 



ANALYSIS AND STATISTICS UNIT - OFFICE OF SCHOOL SAFETY 
ORGANIZATION CHART - JUNE 1974 



CUN IT REPORTS TO O.S.S. TRAINING ADMINISTRATOR] 



ANALYSIS AND 
STATISTICS 
UNIT 



2 Quantitative Analyst* 

1 Supervising Steno 

2 Clerk-Typist 



» 

Formally called Security Systems Analyst while the unit 
was funded by a Criminal Justice Coordination Council 
grant. 
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A work distribution analysis of the unit given tn Exhibit A. 10 shows that 
^3'^ the unit's time is devoted to activities termed "Miscellaneous 
Clerical." The bulk of these tasks involved typing the various daily, monthly; 
and annual logs and reports of school incidents. Much of the unit's remaining ^ 
time was devoted to tabulating and summarizing the incident data for the unit's 
various reports. 

Overall, approximately 85 percent of the unit's professional and clerical 
staff time is consumed by the manual manipulation of the data contained on the .. . 
incident report forms. In addition to its daily incident iog and regular monthly 
and annual incident reports, the unit was often requested to prepare special re- 
ports on individual security matters. These requests came from a variety of- 
fices and individuals, including the Chancellor, other Board of Education offices, 
the Mayor's office The City Council, and special interest groups.. :;|np^^^ 
these special reports were the following: . 

Study of crimes committed with handguns " ^ 
Analysis of crimes committed in school lavatories 
Analysis of crimes committed in school by intruders 
Study of robberies against different types of individuals 
Breakdown of sex offenses by type, victim and perpetrator 
Study of crimes by school, district and neighborhood 
Study of attacks against school guards 

Most of these special reports consist of basic descriptive statistical 
analyses - frequency distributions, histograms and cross-tabulations. With 
almost 5,000 incidents reported in 1973-1974, even these simple studies 
extremely time consuming when computed using only desk calculators. The In- 
cident report form is coded for keypunching but requests by the unit staff to 
BMIDP for the development of a computerized incident reporting system have 
been turned down on the grounds that the relatively low annual volume of data did 
not justify an EDP system. 
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Pupil Accounting and Statistical Division - Bureau of Attendance 

The Pupil Accounting and Statistical Division of the Bureau of Attendance is 
responsible for a variety of clerical and statistical functions relating to pup? 
attendance and transfers. For this study, only the operations of two of the 
division's units were analyzed: 

1. Statistical Unit V 

This unit is responsible for preparing preliminary monthly pupil 
attendance reports by school and district. 

2. Coding and Reports Unit 

This unit is responsible for receiving, processing, and coding 
data on pupil admissions, discharges and transfers prior to 
keypunching by BMIDP. 

These two units have combined staff of 10 administrative personnel and a 
1974-1975 personal service budget of $73,000, Exhibit 2.6 shows an organization 
chart of'the two units within the Pupil Accounting and StatistJca! Division as 
of June 1974. 

A work distribution analysis of the units given in Exhibit A. I I shows that 
60^ of the units' time is devoted to checking and coding data forms. The sta- 
tistical unit spends most ot its time preparing a monthly tabulation of pupil 
attendance rates by school from photocopies of the BEPRAS' Period Attendance Report 
(PAR) forms. This activity provides the Director of Attendance with a "preliminary" 
report for a given month's pupil attendance six to eight weeks before the final 
printout for the particular month is provided by BMIDP. BEPRAS staff also pro- 
duce a manual preliminary pupil attendance report each month for the Chancellor's 
Office. This is a needless duplication of effort. These two parallel activities 
should be consolidated into a single effort and single report to serve the needs 
of the Chancellor and the Attendance Director. 
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EXHIBIT 2.6 



PIFIL ACCOUNTING AND STATISTICAL DIVISION - 
BUREAU OF ATTENDANCE 
ORGANIZATION CHART - JUNE 1974 



ADMINISTRATOR 
I Asst. Administrator 
I Admin. Associate 



STATISTICAL 
UNIT 



1 Supervising Clerk 

2 Clerk 



CODING AND 
REPORTS UNIT 



1 Supervising Clerk 

2 Sen ior Clerk, 
4 Clerk 
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The Coding and Reports Unit Staf fs, annua I l y process approximately 35,000 20?a 
and 209b admission and discharge forms conta i ni ng over one mi II ion I i nes of Infor- 
mation on individual pupils. The 209 forms are an invaluable source of detailed 
information on inter- and intra-city poplulation movements, and contain pupil home 
addresses (both old and new) as well as school and district identification. 
Unfortunately the school and pupil address data are not keypuched and the computer- 
reports presently available provide pupil mobility de'a at only the district and. 
borough levels. 

MAJOR PROBLEMS HINDER ' 
THE EDUCATIONAL 
DATA PROCESS 

The existing fragmentation of organizational responsibility greatly limits 
the Board of Education's abl I ity to successfully meet its educational data 
requirements. This limitation not only affects the ability to meet specific, 
one-time data needs, but a I so affects the mandatory and rout 1 ne report 1 ng needs , 
of the school system. 

While the current situation gives rise to many detrimental consequences, 
there are three major problems that seriously hamper the educational data process. 

Existing Data Units Lack Direct Contact With Management 

This particular problem area is due primarily to the present organizational 
fragmentation. Historically, the educational data units were created as the need 
for particular activities ~ facM ities planning, zoning, school safety — developed 
Most data units, therefore, see their mandate in terms of the particular data 
requirements of their function (or of their immediate organizational superior). 
Unit contact with management ~ the Board of Education, Chancellor, Deputy 
Chancellor, and Executive Directors ~ Is infrequent. 

■ "39 
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This lack of conlact with management has two important consequences. First, 
the passage of time has rendered some data "mandates" obsolete. Data which were 
necessary for the operation of the school system in the |950's are no longer 
critical or even used in the I970's. As a result scarce resources of time and 
staff are employed on activities having little or no value. The data units 
themselves, located far down in the organizational hierarchy and lacking any 
authority to terminate a "mandate" on their own, continue to produce reports; 
which serve no useful purpose. An example of this is the age-grade report which 
BEPRAS has produced for years. The age-grade report is an annual survey on the 
distribution of pupils by age, sex, and grade. The survey imposes a great 
clerical burden on the classroom teacher (who, to do the survey properly, must 
look up the dates of birth for each of his or her students), and its accuracy 
is, therefore, highly suspect. The survey results in six copies of a massive 
computer printout which are all neatly bound and shelved. Within the last 
few years, the only organization which has regularly consulted the age-grade 
reports is the Boy Scouts of New York. Pupil data by age and sex are . 
apparently very useful in the Scouts' membersh i p dr i ves. 

The second consequence of the data units' lack of contact with management 
is by far the more critical. During the past two decades, the Board of Education 
has had to deal with a number of issues arising out of a dynamic social environ- 
ment. Integration, decentralization, and bilingual ism have all imposed great' 
demands on the Board's decision-making ability. As a result, the Board has 
been repeatedly faced with the need for timely, accurate and detai lad data on 
a variety of factors not routinely collected. Such situations call for clear 
lines of authority and responsibility to provide the necessary information. 
The present organizational fragmentation of data units, however, has repeatedly 
resulted in costly and embarassing delays in meeting the information needs of 
the System's policy-makers. 40 
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One recent example can best illustrate the consequences of this situation. 
In 1972, the Puerto Ri can Legal Defense and Education Fund Inc. (ASPIRA) 
instituted an action against the New York City Board of Education concerning the 
lack o^ educational services provided to students with English language diffi- 
culty. Early in 1974, the Board was requested by the Court to make a survey 
of the services provided to all Category 2 (ability to speak I itt le or no English) 
pupils. The Board assigned the task of preparing the survey forms and instruc- 
tions to a data unit not responsible for conducting the regular language survey. 
The survey was conducted in February 1974, with data returns of such poor 
quality that the entire survey was considered useless. It was found that the 
Inadequate instructions had led some schools to include only Puerto Rican 
Category 2 pupils, while other schools Included all Category 2 pupils or 
even all Puerto Rican pupils regardless of their language category. In addition, 
the data collection form used In the survey had no provision for keypunch coding 
so that all tabulations of the survey data would have had to been done manually. 

Because the February survey was found to be useless and there was a Court- 
imposed deadline for the information, a second survey had to be made in May, 1974. 
Due to the time delay caused by the abortive first survey, the May survey placed 
the Board and the schools under a great deal of pressure to complete the task 
before the close of the school year. This pressure, combined with the t"esentment 
on the part of many school personnel in having to conduct the detailed and diffi- 
cult survey a second time, resulted in scores of data errors which could not be 
corrected before the schools closed. 

The Court's final decision In the ASPIRA suit based in part upon the results 
of the May survey, wil I affect the education of tens of thousands of children 
and involve the expenditure of millions of dollars. The need ^or high-quality 
Information In this and similar situations is obvious. Equally obvious Is the 
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■ need for a single agency within the Board to have sol e responsibi I ity for 
working with the system's policy-makers In defining information requirements 
and in ensuring that these requirements are met In an accurate and timely fashion. 

2. Data Unit Operations Are Too Labor-Intensive 

The collection and processing of educational data from the field invariably 
requires careful manual inspection of the data forms for correct cod I ng, legi- 
bility, and missing or obviously erroneous data. The work distribution analysis 
of the data units revealed that a good deal of clerical time is spent on the 
telephone with school secretaries in order to make corrections before the forms 
are processed. 

Manual inspection of completed data forms undoubtably saves more time in the 
overal I process than if errors were corrected after Initial processing. What does 
not save time, however, is the fact that much of this data processing itself is 
done manually. Of the four data units studied, only BEPRAS had the bulk of its 
data processing and reporting done by computer. Both the Programming Section 
of the Office of Educational Facilities Planning and the Analysis and Statistics 
Unit of the Office of School Safety process all of their data manually. 

In the case of the Programming Section, thismanual processing becomes 
an extremely costly and time-consuming activity. Exhibit 2.7 shows the work- 
sheet used by programming section personnel to calculate school bu 1 1 dl ng ca^^a- 
city. Data on enrol I ments\and rooms are transcribed from other reports and forms 
to the worksheets and then all of the computations are made with desk calculators. 
The possibilities for error in transcription and computation are obvious. There 
IS no reason why such purely mechanical tasks cannot be fully automated with 
only manual Inspection of the raw data forms and the computer edit listings. 
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EXHIBIT 2.1 
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Outside of their routine reporting responsibilities, none of the data 
units have the capability to process and analyze data other than manually. 
Any request for even the most rudimentary data analysis (such as a frequency 
distribution of schools by ethnic composition) which has not been generated by 
the regular units reports, will require a manual effort which may take days or 
weeks to complete. Not one of the four data units studied has a single staff 
member who can write a small computer program or use a programmable desk 
calculator. Even after certain requests for data analysis become institu- 
tional ized and required on a monthly basis, staff are pulled away from other 
jobs to pound desk calculators for days on end to get the "special" analysis 
out. 

Whatever problems this lack of automation creates for the data units 
pales before the problems it creates for management. The Board of Education 
is frequently required to provide information pertaining to pupils, programs 
and schools. Frequently, these information requirements, whether from the 
City, State, or Federal Governments, are of such urgency that the luxury of 
one week's time to do a manual analysis simply does not exist. And frequently, 
the Board is forced to use whatever data is on hand to meet the request. One 
can only imagine the ultimate cost to the city's schools because of this un- 
responsive data processing and analysis capability. 

3. Redundant Data Operations Are Common 

In addition to performing many of their operations manua I t y, the data units 
also duplicate each other's manual operations. Because of the existing organi- 
zational fragmentation, data units ere either assigned (or take upon them- 
selves) data processing and analysis functions already handled by other data 
units. 
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BEPRAS is required to produce a monthly pupil attendance ana^tysis for the 
Chancellor's Office, This analysis involves computing school and aistrlct 
attendance rates from the raw data on the monthly period attendance reports 
and comparing these rates with those of the same month for .the' previous school 
year. The Pupil Accounting Statistical Unit of the Bureau of Attendance, however, 
also uses the raw data on the Period Attendance Reports to produce a similar 
analysis for the Director of Attendance. 

Because the computerized pupl I ethnic census reports are not fully corrected 
and avai lable unti I four months after the census Is conducted in October, the 
Chancellor has required BEPRAS to produce a preliminary ethnic census report 
using the raw survey form data. This preliminary ethnic report provides school , 
district, and level summaries of pupil composition weeks before the computer 
report is ready. The Central Zoning Unit, however, also uses the raw survey 
form data to compute a preliminary census similar to BEPRAS. 

These redundant data processing and analysis operations have two detrimental 
consequences. Most apparent, of course, is that redundant efforts are a waste 
of staff time which could be better used on other activities. Perhaps more 
critical to the overall educational data process is that redundant efforts 
result in a proliferation of differing statistics all proporting to be the same. 
Instead of one ethnic census, we have three — the final census and two preliminary 
censuses. Instead of one pupil attendance rate for District 15, there are three. 

The idea of producing preliminary reports from raw data is justified when 
the relative immediacy of these reports Is required by management. Such pre- 
liminary reports, however, cannot be allowed to propogate within the system at will 
And in the Beard of Education, data, having been created once for perhaps a 
single purpose tend to appear in reports and studies for years to come. It 
is important that such preliminary reports be produced by a single unit, 
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which will be responsible for their distribution and will be able to account 
for any future data discrepancies^'due to the reports' misuse. 

^ ^ ^ ^ ^ ^ ^ ^ 

This chapter has discussed the organizational fragmentation of the 
educational data process and how this framentation limits the Board of Education 
ability to meet its management information requirements. Poor organization is 
only part of the overall problem, however. The next chapter details the more 
serious problems inherent in the structure and standards of the educational 
data base. 
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5 - DEVELOPING THE EDUCATIONAL DATA BASE 

The flow of educational data and information is the administrative Ufe- 
blood of the Board of Education. This data flow is a continuous record of the 
status of many of the pertinent factors that affect the successful operation of 
the public school system. A major staff responsibility is the development of 
a mechanism for the selection of the key/critical data from this flood of 
information and the means to have it captured, processed, and fed back to 
assist management in making more effective declslons- 

The educational data base is, or more properly should be, such a mechanism. 
There has been considerable debate among school administrators about the nature 
of the data base; about the elements of information that ought to go into it; 
about the technical complexities created by the concept; and about the real 
value of the concept to the operation of a school system. This chapter examines 
the major shortcomings of the N.Y.C. Public School System's educational data base — 
its structure and standards — and the problems this creates for the Board's top 
decision-makers. 

EXISTING DATA SYSTEMS 
ARE OUTMODED 

At the present tire, decision-makers within the Board of Education are hard 
put to manage ~ and use — their educational data to full potential, for reasons 
that are largely historical. Because of the rapid growth of computer technology, 
managment of data has developed haphazardly and in laggard fashion over the years. 
A general approach to data managment has emerged only very recently, and consequently 
applications have developed discretely from one another in an unintegrated and waste- 
ful fashion. Further, each increase in the complexity and capabilities of computers; . 
has brought new generations of app I icat ions— but these appi icatlons sti I I , for the : 
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most part/ have been specialized in nature, designed for a specific operational 
use or for a specialized staff function. 

Hence, managment of data has continued to develop in framented fashion and 
at rather low organizational levels. Exhibit 3.1 represents the traditional ap- 
; p roach to educational data processing at the Board — collecting and coding data for 
specific programs and thereby linking them more or less permanently and exclusively 
to those programs. ♦ This traditional approach has resulted in three significant 
disadvantages for the data process. 

I . Files And Records Have Tended To Become Redundant 

Exhibit 3.1 shows an over-simplified and hypothetical model of two educational 
data systems — Pup 1 1 Attendance and Title I Eligibility. In the model, the Pupil 
Attendance System uses two data files: The School Register Master File and The 
Period Attendance File. The School Register Master File consists of data elements 
A, B, and C (representing the school identification code, public or private 
school category code and the school register, respectively). The Period 
Attendance File consists of data elements A, C, and D. Notice that data elements 
A and C are common to both files. 

The Pupil Attendance System a relatively old reporting system. A 
few years ago, the Board was required to develop a computer system for detei — 
mining Title I Eligibility. In the model , the Title I El i gl bi I ity System 
consists of three data files: The School Location Master File, The Free 
Lunch Eligibility File, and the Welfare Recipients File. Notice that three 
(A, B, and C) of the seven data elements used In the Title I system are common 
with those used in the Attendance System. 

The redundancy of data is obvious. In just this little, highly sim- 
plified model, 4 out of 8 (50?) of the data elements In ths files are redundant. 
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EXHIBIT 31 

THE EXISTING APPROACH TO DATA 
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During the initial development of data systems, redundancy does not cause much 
trouble. As soon as data elements must be updated, however. It can cause a great 
deal of trouble. Within this simple model alone, for example, the recent creation 
of Community School District 32 involved changing the school Identification codes 
(data elements A) on four of the five files. Given the plethora of data systems 
maintained by the Bureau of Management Information and Data Processing (BMIDP), 
the process of updating all the redundant files and reports In a systematic and 
synchronized fashion becomes exceedingly difficult and costly. 

2. Separate Files Restrict Data Analysis 

The traditional approach to data processing results in separate data 
files feeding into specialized reporting systems. This type of data structure 
severely limits the ability to combine and analyze data elements from separate 
data files. For example. Exhibit 3.1 shows that pupil attendance data (element D) 
and free lunch eligibility data (element F) are contained In two different data 
files. If one wanted to correlate these two data elements. It would be necessary 
to first perform a schoo I -by-school match sort for the two files and then pro- 
duce a new data file containing elements A (school Identification), D, and F. The 
time and effort required to do this often discourages requests for such analyses 
or leads to a manual computation of the data from printouts. 

5- The Traditional Approach Undercuts The Advances of Computer Technology 
Computer merpory was once a great deal more expensive than It Is today. 
The costs of random-access storage have been significantly reduced by the develop- 
ment of extremely large disc devices. V I rtua I -memory techniques make possible 
the analysis of relationships between elements In a relatively huge pool of data, 
not all of which need necessarily be present In literal fact. 
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Originally, the high cost of on-line storage or memory was a main factor 
for limiting the scope of programming and the amount of data needed during 
any given run. In effect, this reinforced the practice of creating and main- 
taining separate files for each app I icat ion required by the Board^s data users. 
Within the near future, the Board will acquire a new IBM 370/158 computer which 
will have the capacity to keep relatively huge amounts of i!ata a I i ve I n the 
system. But the Board's educational data are sti I I organized and coded along 
f I rst-r.]eneration computer lines — that is, by specific files and programs. 

Tha tradit iona I approach to educational data processing Is tied Into tjie 
history of the computer. The computer was first used to replace existing manual 
functions, primarily within the Pupl'l Accounting Function. Next came the inte- . 
grat I on of computer-based systems within and between functional areas. This 
r'3:i.u!ied in data files and systems created originally for one function — child- 
accountiruj — being used for another function — resource al locate -V; frsr i^wample. 

Now Board rnanagment is requesting that the existing cross-functional systems 
be irr.proved to serve the needs of many organizational levels as well as functions. 
At this point, the redundancies and Inefficiencies resulting from the trad it iona I 
approach to educational data managment have become so extensive that applications 
cr.-ir? b':) .jcjoqij.itr) only if they are developed in such a manner that specific pro- 
qrams are separate from the data. Ideally, all of the Board^s educational data 
r>hould be structured into a common flexible data base. 

As i^howp. in Exhibit 3.2, the data-base concept structures Electronic Data 
Processing (EDP) activity so that all of the Board^s educational data are merged 
in a single pool, which is used to run both routine programs and programs written 
in response to ad hoc requests! Note that in the simplified model shown no files 
appear ~ the base of data elements constitutes the general file for the school « 
system, and speci f ic f i I es are by and Jarge unnecessary. In the data-base approach. 
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EXHIBIT 3.2 

THE DATA BASE APPROACH 
TO DATA PROCESSING 
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an interface exists between the common data base and both the general and special 
EDP Systems containing the programs and software for accessing the data elements / 
and producing reports. The data-base approach enables a programmer to organize — 
and structure the data elements in a manner that minimizes or eliminates redundancy ■ 
and optimizes the economic costs of data storage and access! bl Mty. 

MANY DATA FILES 

ARE NOT COMPUTERIZED 

Inflexible and redundant computer data files are only part of the overall 
problem affecting the Board^s educational data base. More serious perhaps Is the ' 
fact that a number of important data "files" are not computerized at all. As was 
discussed in Chapter 2, of the four data units studied, only the Bureau of Educational 
Program Research and Statistics (BEPRAS) had the bulk of Its data processing and 
reporting done by computer. Both the Programming Section of the Off Ice of Educational; 
Facilities Planning and the Analysis and Statistics Unit'of the Office of School 
Safety process and maintain all of their data manually. 

Both of these latter organizations are responsible for data of great importance : 
to the management of the school system. The Programming Section; for example, 
annually collects the following information: 

Inventory and capacity of instructional classrooms,, 
shops, and auxiliary facilities 

Number and grades of pupils enrolled in schools 
outside of their school zone 

Auxiliary organizations housed in public school buildings 
Pupil contribution of large-scale housing developments 

These and other data are used by the Board' in the development of the master : 
plan for public school building construction and the annual space procurement 
program. In addition, they could be used for large-scale analyses of school 
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integration programs and pupil mobility. Such analyses, however, would require 
combining these data with other pupil and demographic i nformat ion, most of which 
presently exist on computer files. A true management information capabi I ity cannot 
exist half-mechanized and half-manual. It is, therefore, necessary that all 
educational data of likely importance to management be computerized and integrated 
into the common data base. 



DATA INVENTORY AND DISSEMINATION 
PROCEDURES ARE POOR 

A data base characterized by inflexible reporting systems and lack of auto- 
mation will undoubtably suffer from an inadequate data inventory and retrieval 
system. The Board's educational data base is no exception. 

In all areas of records management, the four educational data units included 
in hhis study suffer from similar problems: 



Immediate requests for information can generally be 
satisfied only if the data, in terms of format and 
content, are contained in regular unit reports, print- 
outs, or publications. All of the units are tied Into 
their routine report formats; any non-routine . requests 
must" await time-consuming manual computations before 
being satisfied. 

Requests for historical data more than two or three years 
in age often face delays because of chaotic or fnaccesible 
filing systems. Printouts are often left unbound and 
unlabeled in their shipping cartons. Source documents 
are often consigned to a watery fate in the basement due 
to a lack of proper storage space. 

Unit staff are not always familiar with the types of data 
available i n thei r of f ices. Data documentation manua I s 
and information libraries are non-existent and requests 
are often dependent upon the availability of a single 
individual who knows which pile of paper can satisfy 
the request. 

• Much valuable intermediate data contained in tables and 
worksheets are either unobtainable due to poor filing or 
are unusable due to inadequate annotation and documentation. 
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Common sense data summaries are often lacking. Data 
collected by school may not be summarir-^d by district. 
Data summarized by district may not be totaled for the 
entire city. Again requests for summary data not 
routinely reported must await hand computation. 



Data dissemination at the Board of Education is virtually nonexistent. 
With the exception of the small public relations booklet "Facts and Figures", 
the Board ha? not produced a comprehensive publication of educational statistics 

Annual Supe rintendent's Report was discontinued almost ten years ago. 
Those reports it does produce are often merely retyped versions of computer 
printouts, limited in both scope and interpretation. 

An example of the decline in data dissemination is shown in Exhibit 3.3. 
The exhibit gives the' four current BEPRAS reports and a sample of some of the 
now-discontinued reports the Bureau used to produce annually. While not all 
of the old reports were of equal quality or value, they did represent an attempt 
to interpret some of the massive data col lected each year by the Bureau. The 
four current reports suffer by comparison. With the exception of the Language, 
Survey Report, the reports are limited to data tables, some graphics, and a page 
or two of boilerplate - all of which could be generated directly from the com- 
purer. Tfie language report contains ten pages of narrative and attempts to 
t.ighlight historical trends in English language difficulties over a three-year 
period. The time and effort expended on these limited reports is not justified 
by their I imited circulation and value to management. 

in the data dissemination process, too much can be as bad as too little. 
For a number of years, the Programming Section of the Off ice of Educational 
Facilities Planning has published a multi-volume "Program" Planning Data Book" 
for school planning communities and, most recently, for Community School Districts. 
The data books included information on pupil enrollments by grade, existing school 
capacities and utilization rates, detail matrices for three enrol I ment projection 
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EXHIBIT 2.3 
BEPRAS PUBLICATIONS - THEN AND NOW 

I. Current BEPRAS Publications (Annual) 

"Day School Registers by Grade and School Group" 

• "Survey of Pupils who have difficulties with the 
Engl ish Language" 

• "Annual Census of School Population" 

• "Day School Register by School District" 

2. Discontinued BEPRAS Publications (Annual) 

"Teacher experience Index In Elementary and 
Junior High Schools" 

• "Survey of Teacher Absence Policy and Problems 
in large cities 500,000 and over in Population" 

^ "An Analysis of Cessations of Teacher Service in 
the N.Y.C. PubNc Schools" 

• "Teacher turnover in the N.Y.C. Public Schools" 

• "Teachers' salaries in the N.Y.C. Public Schools" 

• "Trends in ethnic composition of Pupil Population 
in N.Y.C. SchooJs" 
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techniques, projected pupil contributions from new large-scale housing, and 
miscellaneous demographic data. The Data Books' value as a planning and infor- 
mation tool was undermined by a surfeit of methodological detail on projection 
techniques. This detail was unaccompanied by an explanatory document discussing 
.the methodology used. It seemed particularly Inappropriate for a planning 
<iocument intended for a lay audience of professionals and public to Include 
countless pages of numeral data (presumably in the name of ful l, disclosure) 
and yet exclude any discussion of what the data signify and how the a 1 1 -important 
summary enrollment projections were made. 

As a result of these shortcomings, the "Program Planning Data Book" series 
was discontinued in 1975. Much of the data contained In the Data Books, however, 
are extremely valuable and should be disseminated in a more Intel I Iglble format 
in the future. 

DATA BASF STANDARDS 
MlED j MP ROVEMENT 

Fragmented administrative control and inadequate computerization of the edu- 
cational data base at the Board has created serious problems for the proper main- 
Terence of data integrity and security. In a number of situations, standards and 
conventions governing data base integrity and security simply do not exist. Where 
such standards do exist, they are often enforced either informally or not at all. 

The enforcement of data base standards, as with data base administration and 
structure, is a function encompassing all three phases of the data process-co.l lection, 
processing, and dissemination. This study has found three aspects of the data ; 
standards function that need immediate Improvement: 
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I. Data Quality Control Varies Greatly 

Quality control of educational data involves the degree to which the sources 
of data are held responsible, the clarity of data element definitions, and the 
extent of edit checks built into the processing system. Because the data is 
defined and collected by four separate units, data quality control is variable. 

In terms of holding the data sources — usually school or district offices — 
responsible for data accuracy, all four data units attempt to do a conscientious 
job. In this they are primarily hampered by personnel and time constraints, and 
an inability to conduct field audits. Of all the data elements collected, only 
the October 31 register and the period attendance reports are subject to an on- 
site audit. The register audit Is conducted by the Office of Audit and Investi- 
gation, and the attendance checks are made by attendance officers and teachers 
assigned to the districts or the Central Bureau of Attendance. The auditing of 
all other data collected by the four data units is generally limited to telephone 
calls to the schools by unit, staff to check on missing or obviously erroneous 
data. 

In all instances, data audits are limited to quantitative factors — numerical 
counts. Qualitative errors in categorization are only picked up if the qualitative 
error results In a qiiant itat i ve error on comparison with previous data. For 
example, the annual language census conducted by BEP^S asks each homeroom teacher 
to classify her pupils In eight language/ethnic categories for one of the three 
levels of English-speaking ability. The census requires the teacher to make two 
relatively subjective judgements about his or her pupils: 

• In terms of ability to speak and understand English, what 
criteria differentiate pupils having a moderate difficulty 
with English from pupils having severe difficulty. The 
criteria provided on the classroom census worksheet allow 
for a good deal of subjective leeway on the teacher's part. 
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* In terms of pupils language group, what criteria differ- 
entiate categorizing a Greek-surnamed and -speaking 
child who has no difficulty with English (Category 3) 
as an English-speaking Category 3 pupil or as a Greek- 
speaking Category 3 pupi i . One teacher would classify 
the pupil as English-speaking, another as Greek-speaking. 

The existing audit procedures for this language census would only notice 
large discrepancies among total pupils in the various categories by comparing 
the census totals with the previous years' f igures. If a teacher or school 
continued to erroneously categorize a particular type of pupil year after year, 
the error — being consistent — would never bo quest ioned. The problem to be 
solved here Is not so much an improvement in audit procedures as it is a 
rigorous redefinition and classi f ication of categories requested on the data 
form. 

For all computerized educational data reports, systems prepared by the Board' 
Bureau of Management Information and Data Processing (BMiDP) conform to N.Y.C. 
Data Processing Standards. BMIDP personnel meet with data clients during the 
development of a new system to ensure that certain edit procedures are built into 
the system. Unfortunately the BMIDP staff is dependent upon the client's 
knowledge of his own data and needs. Because there are many clients from many 
separate bureaus and offices, data edit standards will vary in both degree and 
quality. Systems staff alone can only ensure that the most basic edit checks 
on totals are made by the system. Of course, for those data reports that are 
prepared manual ly, even these most basic edit procedures cannot be guaranteed 
although, as stated above, all data units try their best. 

2. Data Security Standards are Inadequate 

Data security standards ensure that a particular data file or document will 
be maintained and available for use during a designated period of time. In the 
case of 'computer files, BMIDP has a standard procedure for retaining data tapes: 
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• When a system is first designated, the BMIDP systems 
analyst meets with the user bureau and prepares an 
EDP Standard Retention Form I0,50, This form inden- 
tifies the system, file ID number and retention period 
(one year, two years, indefinite) for each file pro- 
duced, 

• If a user bureau has a new requirement to hold tapes 
for longer periods than initially specified, they 
write a memo to BMIDP to modify the original 10.50 
form and also modify BMIDP's Tape Li brary iControl 
System. 

The existing organizational fragmentation of the educational data units has 
led to a partial breakdown of the above system. Data units have no sense of the 
relative importance of their various files. As a result, while some tape files 
are scratched (erased) with?n a month of creation, most are retained for only a 
year or two. Valuable ethnic and language tapes are lost for further analysis 
and the necessary data must be recreated from printouts whose own existence, as 
was shown, ts none too secure. The answer, proposed by some data bureaus, is not 
to retain these files for an indefinite period. BMIDP is currently saving over 
5,000 reels of tape containing data on various applications. €very tape retained 
Indefinitely should be recopled annually to refresh its magnetic Impulses. This 
recopying would only add to BMIDP*s workload. Rather, the answer is to establish a 
data retention hierarchy wherein certain key elements from several master files 
are saved on single annual sumr.-^iry tapes which are retained indefinitely. The 
master tapes themselves can be put on microfilm or microfiche before being scratched 
thereby eiiminating the dependence upota printouts for historical detail data. 

3., Data CoMectlon Forms are Poorly Designed 

One ares of data base standards which lends itself to immediate correction is 
In the design of the data co I t ect I on f orms . Each year, the schools and districts 
are the unfortunate recipients of hundreds of data forms requesting Information 
on every activity and process imaginable. There are dozens: of forms for educational 
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data collection alone. Some of these forms are professionally printed in easy- 
to-work-with colors while others are mimeographed from typed copy. Some forms 
^are boxed and coded for keypunching while most are not. The layout of header 
Information on most forms is not consistent even for forms from the same data 
unit. Some forms have excellent instructions for completion whii.e others leave 
much up to the imagination of the person completing the form. Inevitably, many 
forms ask for the same information. Inevitably, many forms asking for the same 
information are returned containing different figures. 

This quantitative and qualitative multiplicity of daU col lection forms 
stems out of a lack of central control and expertise over the collection process. 
The only workable solution is the establishment of a forms control procedure 
wherein no bureau or office requiring educational data from the field would be 
allowed to send out its own form without prior authorization from the forms control 
unit. Ideally, if the data collection activities themselves were centralized, the 
delay caused by a forms contol review procedure cou Id be largely el iminated. since 
the certiral data collection agency would have the responsibility, and presumably 
the expertise, to develop its own forms. - - 



********* 



This chapter concludes the investigation of the problems inherent in the 
Board's educational data process due to organizational fragmentation* and an 
inadequate data base. The next chapter provides specific recommeiidations for an 
immediate restructuring of the educational data process to alleviate these problems. 
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4 - ACTION PLAN FOR CHANGE 

This study has Identified a number of serious problems in the Board's educa- 
tional data process* Strengthening this data process, thereby enabling it to 
more effectively serve the information needs of the city school system, will 
require a number of major changes in the administration and structure of the 
educational data base. Such changes, to be effective, must impact not only 
on the procedures and systems used by the present data process units, but^ . 
also on the units themselves - their internal structure and traditional 
relationships within the system. 

Accordingly, the action plan consists of the following changes: 

• Create a New Bureau of Educational Statistics 

• Strengthen the Staff Organization . 

• Develop New Computer Systems 

• Establish a Data Center 

• Expand Field Data Audits 

• Adopt a Two-Phase Reorganlzaton Plan 

CREATE A NEW BUREAU 

OF EDUCATIONAL STATISTICS 

One major point regarding the Board's educational data process has clearly 
emerged from this study: almost all of the existing data process problems result 
from the lack of central responsibility for the operation of the process.. No 
effort to strengthen or Improve the mechanisms by which the Board collects, pro- 
cesses, or disseminates educational data will succeed unless there is prior 
formulation of data responsibilities and authority within the framework of a 
single agency. Top priority must therefore be given to the elimination of the 
existing data unit organizations and the restructuring of their staff and. 
functions into a new Bureau of Educational Statistics. 
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Exhibit 4.1 shows the proposed structure of the educational data process. 
Instead of the four existing data units reporting to various offices (see Exhibit 
2A for comparison), the new Bureau of Educational Statistics (BES) will report 
directly to the Deputy Chancellor, This new reporting structure will establish 
the necessary communications link with management that was missing from the old 
organizational structure. If, in the future, a Division or Office of Information 
Systems is created within the Board of Education, BES should be organizationa I !y 
reassigned to that new operation. 

As shown in Exhibit 4.1, no change in the reporting structure or organization 
of the Office of Educational Eva I uat ion (OEE) is being recommended at this time. 
In addition to its other functions, OEE is responsible for the administration of 
all pupil testing. This activity is completely computerized, and the only change 
required (securing copies of pupil test-score tapes for all grades, not just those 
processed by the Board) can be accomplished by a change in the contracts made with 
the test publishers. Also, the creation of the new Accountability Unit within the 
Office of the Chancellor will undoubtably create changes in OEE functions and- 
staff. The ultimate place of OEE in the educational data process must await the 
announcement of these changes. 

It is recommended that BES have the sole responsibility for the collection, 
processing (excluding, of course, actual machine processing), and dissemination 
of all educational data not involving pupil testing. This responsibility should 
extend not only to that data handled by the four existing data units, but also to 
data collected from the field by other Board offices and units. This responsibi i ity 
should include a final review authority to ensure adequate forms design, proper 
coding standards and audit procedures, and to prevent the collection of duplicate 
data. Whenever possible, BES should serve as a data user clearinghouse, con- 
solidating similar data requests by cl lent offices to provide for maximum data * 
utility. No Board unit requiring educational data should be able to send a collection 
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form to the field or specify a report system from the Bureau of Management 
Information and Data Processing (BMIDP) without prior review and approval by 
EES. This review and control procedure for EES is necessary if there is to be 
effective management of the educational data base. 



STRENGTHEN THE 
STAFF ORGANIZATION 



Assigning extensive authority to the Eureau of Educational Statistics will 
have little real effect on the management of the educationa I data base if the 
proper staff organization for the Eureau does not exist. This proper staff 
organization includes the restructuring of sub-bureau units along strictly 
functional lines and the creation of appropriate staff positions. 

Exhibits 4.2 'shows the proposed organization of the Eureau of Educational 
Statistics for the period from Janaury I, 1975 through June 30, 1975 (Phase 
I of the reorganization plan). It :'>^commended that the new Eureau be 
organized into three units: 

• Field Data Collection Unit 

* Management Information Unit 
^ Demographic Analysis Unit 

I . Field Data Col lection Unit 

Under the supervision of an Assistant Administrative Director, this 
unit will be responsible for the collection, processing and editing 
of a I I statistical data collected form the field. Along with the 
regular pupil-related data collected by EEPRAS' units, this unit 
will collect and process school facilities data, pupil admissions 
and discharge data, and school incident data. In addition, the 
unit will be responsible for conducting all special surveys man- 
dated by Board of Education management of State and Federal agencies. 
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BUREAU OF EDUCATIONAL STATISTICS 
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2. Management Information Unit 

Under the supervision of a Principal Methods Analyst, this unit 
will be responsible for the development of new computerized reporting 
systems to replace both existing manual procedures and inadequate com- 
puter systems. The unit will have primary responsible for maintenance 
of the educational data base, installation and operation of microfilm 
equipment for data storage and retrieval, and dissemination of all 
statistical information requested by the Board or outside agencies. 

3. Demographic Analysis Unit 

Under the supervision of a Senior Quantitative Analyst, this unit 
will be responsible for the development of a computerized geographic 
data base for generating enrollment projections, facilities require- 
ments, and demographic analyses at varioujs geographic levels. This 
unit will also maintain a library of po^/ulation and socioeconomic 
data files produced by City, State and Federal statistical agencies. 



Because the proposed BES organization will require a range of new skills and 
expertise, certain changes In staffing will be necessary. It is recommended that 
the following m -> positions be created for BES: 



I. Director of tiducatlonal Statistics 



This administrative position will be responsible for the overall 
supervision of BES and will replace the two existing pedagogic 
director positions In BEPRAS and the Programming Section. Because 
the BES reorganization places very heavy emphasis on the develop- 
ment and operation of management information systems, it is re- 
commended that the BES Director position be established as a 
Principal Quantitative Analyst line at the M-IV salary level In 
the Managerial Pay Plan. This action will ensure that future 
incumbents in the BES Director position will possess the neces- 
sary technical background for the position. 

2. Associate Methods Analyst 

This administrative position wiii be asslgrecf :c the BES Director 
and will be responsible for conducting v*ork a-^c^lysls and improvement 
studies of data process activities wlthl'n BES and other Board offices. 
This position will also prepare and maintain a BES Procedures and 
Standards Manual of the Bureau's functions. 



3. Senior Quantitative Analyst 

This adminh:1ratlve position will supervise the BES Demographic 
Analysis Unit and will have primary responsibility for the 
development of the Geographic Data Base System and the preparation 
of various demographic analyses. 
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4, Qucintitative Analyst 

This administrative position will be assigned to the Demographic 
Analysis Unit and will be responsible for developing the Pupil 
Nbbility Reporting System and for assisting the Unit Supervisor 
In analyzing demographic data. 

In addition to these four new positions, It is recommended that four admlnfc- 
trative positions (i Principal Methods Analyst, I Associate Methods Analyst, 
J Senior Prograr^nrier, and I Supervising Stenographer) from the Project Management 
Unit be 'reassigned, to the BES Management Information Unit through the duration 
of Phase 2 (June 30, 1976). This team will be responsible for the developmen-J- 
of a number of new computerized reporting systems which should result in sig- 
nificant savings in processing tir j and labor costs for the new Bureau, 

Bec^i. the emphasis within BES will be on Information systems development, 
there wi I I be little need for the three BEPRAS pedagogic research positions 
(i Assistant Director and 2 School Research Associates) within the new Bureau. 
These positions should be transferred to other r;oard activities such as Ed- 
ucational Evaluation or the Accountability Project where their traditional 
research expertise could be more appropriately utilized. 

DEVELOP ^EW 
COMPUT-£R SYSTEMS 

This study indentified a number of shortcomings in the existing systems 
and procedures used in processing educational data. Most of these shortcomings 
centered around manual data processing or limited and Inflexible computer 

programs and files. AccordJngly, it is recommended that the following new 

computer systems be d^ivetopad during Phase I of the reo^ -tc.^'h zat ion : 

I . Annual School Census System 

This system will replace the many existing overlapping manual and 
computer systems now used to collect pupil and school facility data 
for. the annual October 31 School Census. This system will form the 
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basis of a comprehensive grade-within-school data base. Data wii; 
be collected on a single fan-fold data form coded for keytape, re- 
placing a dozen printed and mimeographed ^^or^ns now used to collet 
the data. This new form will eliminate the coi lection of duplicate 
data and should significantly ease the clerica I burden imposed upon 
the schools and consequent iy el iminate many clerical errors. The 
rew system will provide for exception and special summary reports 
in addition to the regular detail reports, 

2. Geographic Data Base System 

This system will provide for the collection and processing of demo- 
graphic data down to the block level of detail. Through the use 
of the NYC Department of City Planning's Street Address Matching 
System (SAMS), data now collected by various agencies at the street 
address level can be suii:>mar i zed by school attendance zones, neigh- 
borhood boundaries and ccmmunity district areas. Included among 
these data are Welfare files, N.Y. State Income Tax files. Resident 
Births and Deaths by ethnic group. Real Estate Assessed Valuations, 
Sanborn Housing files, <jnd Pupil Admissions and Discharges. As 
all of these data are coMected annually, they can provide very 
detailed and up-to-date inventories nf {J^=^mograph ic i nforr'iatior to 
support such Board activities a^^ sohoc! zoning, enrol I ment Tele- 
casting, redistricting, pupil busing and integration studies. 
The Geographic Data Base System wi^! aiso produce a varfety of 
compjter-generated maos for I nformcjtlona I and analytic needs, 

^ ^'^ci dent Reporting System \ 

This time-share computer system will provide for the entry a'^nd 
processing of school incident data, replacing the existing manual 
system used by the Office of School Safoty. The computerized I in- 
cident file created by this system can be accessed via remote 
terminal to generate a variety of incident reports and statisticel 
analyses. In addition, monthly summaries of dcta by school from 
the Incident file Viill be incorporated into the comprehensive 
grade-withi n~school da1a base to support more sophisticated, 
multivariate analyses of school incidents. 

4. Pupil r^bility Reporting System 

>, is system will generate detailed reports of pu^II admi scions 
and discharges do^^^r. to The school level, replacing the present 
systems which p.-ovide only borough and district mobiMty summaries,. 
A sample of the admission and discharge r^jports will have old and 
new pupif addresses keypunched to provide detailed mobiirty data 
for analysis by the Geographic Data Base System, 
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5. Professional Staff R eporting Sy s tem 

This system wHI provide flexible access to position and salary 
data contained en tie rt^^qalar (Ry^O) and per-diem (DEI70) pro- 
fessional st'iff pay^'olls. Replacing an existing and inadesquate 
systen;, the now sysrem in I I provide staff salaries and step,- 
disYributiori> for any geogr2phIc or organizational level, 
salary schedule, or position title. The system will generate 
inTormsiion necessc-ry to^" analyzing personnel survival trends 
and for determining Irng.-range costs of collective bargaining 
sa I ary offers. 

6 . Preliminary Reports Sy stem 

Tins time-share computer system will produce orv-demand reports 
and analyses of "ra^;" or preliminary data such as pupil attend- 
ance or ethnic composition. Using a small and interactive data 
base report program, this system wil I replace many of the costly 
and tine-consuming manual procedures now used regu'arly to produce 
preliminary or special data reports. 

The development of these new computer systems will form a part of an 
overall improvement in the educational data storage and retrieval {process. 
Exhibit 4.3 shows a schem^ic diagram of the proposed process to be initiated 
during Phase I of the BES reorganization. in the piroc^^7 master data files 
of annual, monthly and daily data are created and maintained for designated 
retention periods based upon newly-established user requirements. Formatted 
print tapes for each of these fl les are sent out on a regular basis to a com- 
mercial Computer Output Microfilm (COM) company for conversion to microfi Im 
for permanent storage. These tapes are also run through a Summary Data 
System on an annual basis to produce annual summary tapes for permanent storage. 
The TTTost recent year summary data file is maintained on-line on a disk file to 
permit the generation of on-demand reports and analyses using a remote terminal. 

Properly developed, the proposed data storage/retrieval process described 
above will be able to support most of the Board's data and analysis require- 
ments through the balanced maintenance of tape, disk, and microfilm data files. 
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EXHIBIT 4.3 
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ESTABLISH A 
DATA CENTFR 



As was discussed in Chapter 3, this study found that data inventory and 
dissomJ nation procedures at too l3oard are inadequate- Data tapes are pre- 
nr:ture I y scratched, surviving printouts are in daily peril, data tables and 
records are misfiled, and many data requests must await time-consuming manual 
computations before beina saiSsfied. 

Organizational and systems efforts to improve the educational data base 
will be largely wasted if 1he means by which this data can be stored, retrieved 
and disseminated are not deyelopsd. It is therefore recommended that a data 
center be created within the BBS Management Information Unit. The data center 
will be the central repository for all of the Bureau's data files, reports and 
sources, as well as data from other Board offices and City, State and Federal 
sources. The center, in addition to handling a!! requests for data, will be 
responsible for the following activities: 

1. Microfilm Existing Data Records 

The data center will lease a 16mm microfilm recorder (camera) 
to copy existing data printouts and records on microfilm car- 
tridges. All cartridges will be sequential ly indexed to permit 
rapid access of specific records. A priority schedule will be 
developed to determine the categories of data to be microfilmed, 
as well as the necessary level of detail and the num'i)cr of his- 
torical years to be copied for each data category* The center 
will also lease a microfilm reader/printer for date? retrieval 
by display screen or hardcopy. Data center staff wi I I be trained 
to handle all aspects of the microfilm operation. 

2. Recreate Historical Computer Fi les 

Data center staff will be assigned to code certain printout or 
tabular data onto keypunch forms for the creation of machine- 
readable fi les of those data. A review will be made to determine 
the types of data and historical years of interest to be Created. 
Because of the clerical effort involved and the possibilities for 
transcription error, only those data (such as pupil ethnicity by 
school) necessary for computerized longitudi na I analyses will be 
keypunched. ^ ~ 
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3. Supervise Production Of Data Reports 

The data center will bo responsible for the preparation and 
distribution of all BES data repor^ts to c I ien+s wi th i n the 
NYC Public School System and from outside agencies. This 
will include all aspects in the production of the annual 
School Profiles Handbook which will serve as the Board's 
primary source of educational statistics. All data inquiries 
and publication sales will be processed through the data center. 



EXPAND 

FIELD DATA AUDITS 



If data quality standards are to be maintained, it will be necessary to 
expand the number and extent of field data audits. As discussed in Chapter 
3, only the October 31 Register and the period attendance reports are currently 
subject to an on-site audit. The auditing of all other educational data collected 
at the Board is generally limited to telephone calls to the schools by data unit 
staff to check on missing or obviously erroneous data. 

It is recommended that a more comprehensive field data audit be made of 
BES-col lected data. This is particularly true of school facilities data regarding 
the reported u5G o? Instruct iona I rooms. Deliberate errors in these reported 
data can result in lower school capacities and restrict Board efforts to promote 
t,c;hccl integration. In most instances, field data audits should be conducted 
on a sr^mple basis, stratified to cover more of those schools which have given in- 
accurate or inconsistent data In the past. Because educational data audits are 
primarily required only in the Fall, ine field audit -staff should not be assigned 
to BES. Such staff should be attached to a unit having responsibi lii ; for auditing 
a wide variety of data over the course of the entire school year. 

ADOPT A TWO-PHASE 
REORGANIZATION PLAN 

The above recommendations for the restructuring of the educational data 
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process should be imp I emented over an eighteen month period consisting of 
two phases. 



Phase I - This phase will extend from January I, 1975 through 
June 30, 1975. At the outset of this phase, the Bureau of 
Educational Program Research and Statistics (BEPRAS) and 
selected staff from the Office of Educational Facilities 
Ptanning's Programming Section and the Office of School 
Safety's Analysis and Statistics Unit will be incorporated 
into the new Bureau of Educational Statistics (BES). Work 
w! I I begin on the development of the six new computer systems 
recommended above, and on microfilming educational data files. 
It is expected that three (Incident Reporting System, Pro- 
fessional Staff Reporting System, and Preliminary Reports 
System) of the six new systems will be operational by the 
end of Phase I . 

Phase 2 - This phase wilt extend from July 5, 1975 through 
June 30, 1976. At the outset of this phase. Educational 
Faci I ities Planning's Programming Section and School Safety's 
Analysis and Statistics Unit, together with units of the Bureau 
of Attendance's Pupil Accounting Division will be merged into 
BES. In addition. Phase 2 will see the incorporation into BES 
of other data units not included in this initial study. As of 
this writing, likely candidates for merger include the Bureau 
of School Financial Aid's Survey Unit and certain functions of 
the Central Zoning Unit. 



During Phase 2, the three remaining new computer syst*?:rms (Annual School 
Census System, Geographic Data Base System, and Pupil Mob i 11 ty Report i ng System) 
will be completed and operational. Much of the ongoing Phase 2 effort will be 
directed toward Implementing the proposed educational data storage and retrieval 
process shown in Exhibit 4.3, and conducting a series of community school district 
and neighborhood demographic studies of socioeconomic transition and pupil mobility. 
Systems studies will also be made by BES personnel of other data collection func- 
tions at the Board of Education for possible computerization- 
Dividing the restructuring of the educafional data process I nto phases will 
permit the prior mechanization of specif Ic data functions before they are merged 
into BES. The actual restructuring process for each phase will consist of a 
number of interrelated steps. Exhibit 4.4 provides a flowchart of the systems 
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development and, reorganization process for Phases I and 2. The stages in the 
restructuring process are summarized below: 



Feasi bi I ity Study 

The first step in the restructuring process is the feasibility 
study. This is the identification of specific data process 
needs and an examination of possible alternative solutions 
given constraints of technology, resource availability, and 
organizational structure. The end product of the feasibility 
study is a detailed work plan containing project milestone 
charts, staff assignments, and resource requirements for each 
recommended task or activity in the upcoming phase. 

Systems Requirements 

« 

Following the decision to implement a systems activity, the 
data requirement statement needs to be defined more precisely 
and completely than it was in the feasibi I ity study. In this 
stage, the objectives, policies, and constraints of the user 
must be stated completely and in operational terms. 

Systems Design 

The data requirements statement is the basis on which a systems 
analyst creates and designs the system. The systems design is 
a set of detailed specifications for each component of the system. 
The main components are the following: 



1. Hardware Preparation - The development of new data systems may 
involve the selection and instal lation of equipment such as 
computer terminals, special filing systems and microfilm hard- 
ware. This usually involves technical decisions made by special Ists 
and consultants, but these decisions often co. management. In- 
asmuch as equipment requires allocation of funOw, staff training, 
and space availability. 

2. Systems Programming - Once a system is designed, computer programs 
must be written to I nstruct the computer as to how to produce the 
desired reports. Systems programming must take into account the 
report needs and flexibilities of the data user, as well as the 
user's technical ability to use and support the system. 

3. Procedures Development - Procedures provide information on how, 
why, and when a job Is to be performed. Most systems have pro- 
cedures which must be designed and tested carefu 1 1 y because they 
often determine both the effectiveness and efficiency of the 
system. 
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4- Organ i zat 1 ona I Changes - New data systems often require that 
jobs be performed differently and by d i fferent personnel . 
This may require structura I changes i n the organization, and 
may result in displacement and transfer. In addition, personnel 
using the new system must be trained and the administrators in- 
volved must be oriented as to the "how" and "why" of the new 
system. 

Systems Testing 

Once the data system is programmed, procedures developed, hard- 
ware prepared, and organizational changes implemented, the system 
is ready for testing. Depending upon the approach required, new 
systems could be tested in parallel to the old, or^tjynjsing pilot 
data on a small scale. The test results are compared with the 
specifications stated in the Systems Requi rements stage. !f un- 
sat i sfactorv. the system is modified or redeveloped. If satis- 
factory, the system is then ready for operation. 

Project Control 

The development of a new data system with a large number of 
interrelated activities is organized as a project ./ Its activities 
must be planned, scheduled, and control I ed if it ^s to be completed 
within the desired time and within the resources ^a I located for the 
'project. To accomplish this, project management tech'niques such 
as the Gannt chart, the Critical Path Method (CRM), or the Program 
Evaluation and Review Technique (PERT) are used. 



In order to begin the Phase I reorganization and systems development on 
January I, 1975 it is recommended that the Phase I Feasibility Study and Work 
Plan be completed by December 16, 1974. The Phase 2 Feasibility Study and Work 
Plan should be completed by May I, 1975 so that the Phase 2 restructuring can 
begi n on July 1 , 1975. 
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APPENDIX A 

WORK DISTRIBUTION ANALYSIS - PRIMARY DATA PROCESS UNITS 

As part of the educat lona I stat i st ics study, work distribution analyses 
were conducted for each section of the four primary data process units. In 
essence, a work distribution analysis is a list of the major work activ' ,ies 
done in a particular unit, how much time each employee spends on each activity, 
and what specific contribution he makes to that activity. The analysis helps 
to spotlight uneven work distribution, improper use of skills, misdirected 
effort, and activities requiring the most time, as we M -,3S whether or not 
assigned tasks are related, imba lanced, or spread too thinly. 

In this analysis, each unit employee was requested to list on a form all 
of his specific tasks and give an estimate of the number of hours spent per 
week on each. Wherever possible, these tasks were grouped into unit activities. 
Thus the BEPRAS activity "Pupil Attendance Report" consists of such tasks as 
mai I ing*forms, logging returned forms, checking data accuracy, telephoning 
schools for missing data, and reviewing computer edit listings. 

Exhibits A.I through A. I I show the summary work distribution analyses 
for each data process unit and its sections. Not apparent in the analysis 
displays is the high proportion of manual effort which makes up most data 
unit activities. This problem is discussed In detail in Chapter 2. 
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EXHIBIT A.I 

WORK DISTRIBUTION ANALYSIS 
BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 

BUREAU ACTIVITIES MAN HRS/WK ^ OF TIME 

Bureau Supervision 78 5 

Inter-Agency Liaison 13 I 

Administrative Researc^h |4 | 

Pupil Information Survey 51 4 

Comparabi I Ity Report 2 0 

EEOC Survey 2 0 

BEDS Survey 39 3 

Comparative Statistical Studies 2 0 

Pup i I Attendance Report 238 18 

Grade and Register Report 102 8 

Language and Ethnic Report 120 9 

Miscellaneous Reports 177 13 

Teacher Absence Survey 72 ' 5 

Teacher Salary Reports 7 2 

internal Bureau Surveys 7 2 

HEW Surveys 7 2 

General Report Processing 91 7 

Data Dissemination 31 2 

Bureau Publications |4 | 

Statistical Tabulation 29 2 

Records Maintenance 13 . \ 

Correspondence 25 2 

Mai I Hand I I ng 39 3 

Personnel Records 40 3 

Other Clerical 152 10 

Bureau Total I ,365 100 
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EXHIBIT A. 2 



WORK DISTRIBUTION ANALYSIS 
BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 
PROGRAM RESEARCH UNIT 



UNIT ACTIVITIES MAN HRS/WK % OF TIME 

Unit Supervision 4 4 



Comparative Statistical Studies 


2 


2 


Language and Ethnic Report 


5 


5 


Miscellaneous Reports 


7 


7 


Teacher Absence Survey 


72 


68 


Teacher Salary Report 


7 


7 


Miscellaneous Clerical 


. 8 


8 


Unit Total 


105 


100 



EXHIBIT A. 3 



WORK DISTRIBUTION ANALYSIS 
BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 
ADMINISTRATIVE RESEARCH UNIT 



UNIT ACTIVITIES MAN HRS/WK % OF TIME 

Unit Supervision 4 2 

Inter-Agency Liaison 2 I 

Administrative Studies 14 8 

Pupil Information Survey 51 30 

Comparability Report 2 I 

EEOC Survey 2 I 

Language and Ethnic Survey 30 17 

Internal Bureau Studies 7 4 

HEW Surveys 7 4 

Miscellaneous Studies 5 3 

"^Mai I Handl Ing 4 2 

Miscellaneous Clerical 47 27 

Unit Total 175 100 
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EXHIBIT A. 4 



WORK DISTRIBUTION ANALYSIS 
BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 
FIELD DATA COLLECTION UNIT 



UNIT ACTIVITIES 



MAN HRS/WK 



% OF TIME 



Unit Supervision 
Inter-Agency Liaison 



32 
9 



4 
I 



Pupil Attendance Report- 
Grade and Register Report 
Language and Ethnic Report 
Miscellaneous Reports 
General Report Processing 
Data Dissemination 
BEDS Survey 
Mai I Handl Ing 
Miscellaneous Clerical 



238 
102 
85 
170 

9.: 
ji 
•* 

59 
35 
35 



28 
12 
10 
20 
II 
I 

5 
4 
4 



Unit Total 



840 



100 



EXHIBIT A. 5 



WORK DISTRIBUTION ANALYSIS 
BUREAU OF EDUCATIONAL PROGRAM RESEARCH AND STATISTICS 
MANAGEMENT SUPPORT UNIT 



UNIT ACTIVITIES 

Unit Supervision 
Inter-Agency Liaison 



MAN HRS/WK 

3 
2 



% OF TIME 

2 
I 



Data Dissemination 
Bureau Publications 
Statistical Tabulations 
r<ecords Maintenance 
Bureau Personnel Records 
Miscellaneous Clerical 



27 
14 
24 
3 
40 
62 



15 
8 

14 
2 

23 

35 



Unit Total 



175 



100 



83 
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.EXHU'3IT A. 6 

WRK DISTRIBUTION ANALYSIS 

PROGRAMMING SECT?0;^' - OFFICE OF EDUCATIONAL FACILITIES PLANNING 

BUREAU ACTIVITIES MAN HRS/WK % OF TIME 

Section Supervision 64 9 

Inter-Agency Liaison 7 | 

School Utilization Report 31 5 

School Utilization Maps 12 2 

i'icncol Capacity Analysis 23 4 

:ohool Uti I Ization Analysis 8 1 

Pyijoo Inventory Analysis 10 I 

School Fad I ity Anal ysis 10 | 

Leased Facility Analysis 9 I 

Annual Housing Analysis • 62 8 

Capital Budget Analysis 18 3 

Pupil Transportation Analysis 13 2 

Public School Enrol I ment Analysis 125 18 

Non-pub I ic Enrol Iment Analysis 2 0 

Census Data Analysis 19 3 

Space Procurement Program 8 I 

Annual Birth Data 12 .2 

Graphics 33 5 

Miscellaneous Analysis 18 3 

School Site A^.TlysIs 5 I 

Records Maintenance 24 3 

Correspondence 31 4 

l^iscel laneous Clerical 156 22 

Section Total 700 100 

t 



84 
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EXHIBIT A.7 



WORK DISTRIBUTION ANALYSIS 
PROGRAMMING SECTION - OFFICE OF EDUCATIONAL FACILITIES PLANNING 

SCHOOL UTILIZATION UNIT 



UNIT ACTIVITIES 



MAN HRS/WK 



% OF TIME 



Unit SuperviHion 
Inter-Agency Ltaison 



5 
3 



4 
2 



School Utilization Report- 
School Utilization Maps 
School Capacity Analysis 
Room Inventory Analysis 
School Facility Space Analysis 
Leased Facility Space Analysis 
Graphics 

Miscellaneous Analysis 
Records Maintenance 
Miscellaneous Clerical 



18 

12 
15 
10 
5 
3 
3 
3 
20 
43 



13 
8 

I I 
7 
4 
2 
2 
2 

14 

31 



Unit Total 



140 



100 



85 
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EXHIBIT A. 8 



WORK DISTRIBUTION ANALYSIS 
PROGRAMMING SECTION - OFFICE OF EDUCATIONAL FACILITIES PLANNING 
PROGRAM-PLANNING AND RESEARCH UNIT 



UNIT ACTIVITIES 



MAN HRS/WK 



% OF TIME 



Unit Supervision 
Intel — Ager. Liaison 



21 

2 



6 
I 



School Utilization Report 
School Capacity Analysis 
School Facility Space Analysis 
Leased Facility Space Analysis 
Annual Housing Analysis 
Capital Budget Analysis 
Pupil Transportation Analysis 
Public School Enrollment Analysis 
Non-public Enrollment Analysis 
Census Data Analysis 
Space Procurement Program 
Annual Birth Data 
Graphics 

Miscellaneous Analysis 
School Site Analysis 
Miscellaneous Clerical 



2! 
8 
5 
5 
2 

!5 
4 
107 
2 

19 
6 

!7 

30 

t5 
5 

70 



5 
I 

33 
I 

I 

J 

6 
4 



Unit Total 



350 



'00 



86 
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FXHJBI' 



WORK DISTRIBUTION ANALYSIS 
PROGRAMMING SECTION - OFFICE OF EDUCAT30NAL FACILITIES PLANNING 

HOUSING RESEARCH UNIT 



UNIT ACTIVITIES 

Unit Supervision 
Inter-Agency Liaison 



MAN HRS/WK 

3 
2 



% OF TiME 
2 



Leased Faci I ity Space Ana lysis 
Annual Housing Analysis 
Capital Budget Analysis 
Pupil Transportation Analysis 
Public School Enrollment Analysis 
Space Procurenient Program 
Correspondence 
Miscellaneous Clerical 



60 
2 
9 

18 
2 
8 

35 



44 
I 

6 
13 
I 

6 

25 



Unit Total 140 100 



87 
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EXHIBIT A. 10 



WORK DISTRIBUTION ANALYSIS 
PLANNING- SECTION - OFFICE OF SCHOOL SAFETY 
ANALYSIS AND STATISTICAL UNIT 



UNIT ACTIVITIES 


MAN HRS/WK 


% OF TIME 


Dai ly Lo; of Incidents 


12 


7 


Monthly Inciaent Report 


3 


2 


Special Reports 


3 


2 


Liaison with Schools 


15 


9 


Inter-Agency Liaison 


2 




Systems Des.jgn 


15 


9 


Data Tabulation and Analysis 


13 


7 


Forms Design 


3 


2 


Records Maintenance 


31 


18 


Miscellaneous Clerical 


78 


43 


Unit Total 


175 


100 



88 
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EXHIBIT A. 1 1 



WORK DISTRIBUTION ANALYSIS 
PUPIL ACCOUNTING AND STATISTICAL DIVISION - BUREAU OF ATTENDANCE 
STATISTICAL, AND CODING AND REPORTS UNITS 



UNIT ACTIVITIES MAN HRS/WK % OF TIME 

Supervi sion 35 .11 

Forms Coding and Checking 186 59 

Records Maintenance 13 4 

Telephone Data Checking 24 8 

Ma i I Hand I i ng 20 6 

Other CI erica I 39 |2 

If 

Unit Total 315 100 



89 



